
United States Patent and Trademark Office 



UNITED STATES DEPARTMEr^TT OF COMMERCE 
United States Patent and Trademark OfHce 
Address: COMMISSIONER FOR PATENTS 
P.O, Box M50 

Alexandria, Virginia 223I3tI45P 
www.uspto.gov 



I ATTORNEY DOCKET NO. |' Qg^FlRMATlON NO. " 



APPLICATION:NO; 



RLING DATE 



HRST NAMED INVENTOR 



'09/592,285' 



" ■ OVl 2/2000 



7590 



25944 

OLIFF & BERRIDGE, PLC 
P.O. BOX 19928 
ALEXANDRIA, VA 22320 



07/02/2004 



KEN UTAGAWA 



106477 



5210 



EXAMINER 



EDWARDS, PATRICK L 



ART UNIT 



PAPER NUMBER 



2621 

DATE MAILED: 07/02/2004 



] 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action Summary 



Application No. 

09/592.285 


Applicant(s) 

UTAGAWA, KEN 


Examiner 

Patrick L Edwards 


Art Unit 

2621 





•• The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply v^\\\, by statute, cause the application to become ABANDONED (35 U.S.O. § 133). 
Any reply received by the OfHce later than three months after the malting date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

!)□ Responsive to communication(s) filed on 20 April 2004 . 
2s)M This action is FINAL. 2b)n This action is non-final. 

3) 0 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) 13 Claim(s) 1-13.15,16,19,21 and 22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) EI Claim(s) 2 and 3 is/are allowed. 

6) M Claim(s) 1.4-13,15.16.19,21 and 22 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or foma PTO-152. 

Priority under 35 U.S.O. § 119 

12) S Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (0- 
a)IEl All b)n Some * 0)0 None of: 

1 ,M Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17,2(a)). 
See the attached detailed Office action for a list of the certified copies not received. 
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1 ) M Notice of References Cited (PTO-892) 

2) n Notice of Draflsperson's Patent Drawing Review (PTO-948) 

3) 13 Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date 14. 



4) S Interview Summary (PTO-4 13) 
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5) CD Notice of Informal Patent Application (PTO-1 52) 
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DETAILED ACTION 

1 . The response received on April 20, 2004 has been placed in the file and was considered by the examiner. 
Aq action on the merits follows. 

Response to Arguments 

2. The applicant's arguments filed April 20, 2004 have been fully considered. A response to these arguments 
is provided below. 

Specification Objections 

Summary of Argument: The specification was initially objected to (page 1 lines 4-10 of the 
applicant's specification) as a result of improper incorporations by reference. The applicant has amended 
the specification by deleting the paragraph on page 1 lines 4-10 which contained the in:proper 
incorporations. 

Examiner Response: The applicant has deleted the aforesaid paragraph which contained 
inproper incorporations by reference. Consequently, the original objection to the specification is now 
moot and is hereby withdrawn. 

Claim Rejections - 35 USC § 112 

Summary of Argument: Claim 6 was originally rejected under 35 U.S.C 1 12, second paragraph 
as being indefinite because of an inconsistency with the parent claim (claim 4). Claims 7 and 8 were 
rejected because they were dependent on an indefinite claim The applicant has amended claim 6 to 
depend fi:-om claim 1, instead of claim 4. The apphcant asserts that this amendment eliminates any prior 
claim indefiniteness. 

Examiner 's Response: The examiner is persuaded that the amendment to claim 6 has cleared 
up the previous 1 12 issue. However, the amendment has created a new 112 2'''* paragraph issue which 
will be discussed in the rejection below. Consequently, claims 6-8 are still rejected under 35 U.S.C 1 12, 
second paragraph. 

Claim Rejections - 35 USC § 102 

Summary of Armment : Claims 1, 2, 14, 17 and 19-21 were originally rejected under 35 USC § 
102(b) as being anticipated by US Patent No. 5,771,318 issued to Fang et al. 

Claims 14, 17 and 20 have been cancelled and their prior rejections are now moot. 
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The applicant has amended claim 1 and argues that this amendment overcomes the prior art 
rejection. More specifically, the applicant argues that the Fang reference fails to disclose an image 
processing method where similarity is judged by using characteristic differences among a plurahty of 
pixels located on lines passisng through the target pixel along specific directions, and passing near the 
target pixel along specific directions. 

Amended claim 2 is now independent. It contains some of the limitations from the original claim 
3. The applicant argues that the Fang reference fails to disclose several of the features of the amended 
claim and asserts that the claim is now allowable over the prior art. 

The appHcant has also amended claims 13 and 19, both of which are now in independent form 
The appUcant that the Fang reference fails to disclose several of the features of the amended claims and 
asserts the the new claims are now allowable over the prior art. 

Examiner 's Response : With regard to claims 1, 13 and 19, the applicant's arguments have been 
considered but are moot in view of the new grounds of rejection necessitated by amendment. The new 
grounds of rejection are provided below. 

With regard to claim 2, the applicant's amendments to the claim and subsequent arguments 
regarding the amendment have been considered and are persuasive. Claim 2 and its dependent claim are 
allowable over the prior art. 

Claim Rejections - 35 USC § 103 

Summary of Argument : The applicant argues that the prior 103 rejections should be withdrawn 
because none of the reference combinations disclose the limitations of the newly amended independent 
claims 1,2, 13 and 19. The appHcant argues that the claims which depend from these claims are 
allowable as well. 

Examiner 's Response : The applicant's arguments with respect to claims 4-12, 15-16 and 21 have 
been considered but are moot in view of the new groimds of rejection necessitated by amendment. 



Claim Rejections - 35 USC § 112 
3. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 
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The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

4. Claims 6-8, 13, 15-16, 19 and 21-22 are rejected under 35 U.S.C 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matta- A^diich applicant regards as the 
invention. 

With regard to claim 6, the phrase "said first similarity values" recited in the claim lacks antecedent basis. 
Claim 6 depends back from claim 1, which makes no mention of a "first similarity value" or even a "similarity 
value". 

Claims 7 and 8 are rejected as being dependent on an indefinite claim. 

With regard to claims 13 and 19, the metes and bounds of the phrase "a weighting rate to said first color is 
high" are indefinite as recited in the claim. After reading this phrase it isn't clear what a 'weighting rate to said fnst 
color' is referring to, or why it would be high or low? Is this weighting rate high in relation to something else? 
Which weighting rates qualify as high and which weighting rates qualify as low? This phrase could be interpreted to 
mean that the weighting rates are largely determined by one color, or it could mean that one color of an image 
receives more weight than another color in the subsequent weighted avering operation, or it could mean something 
else entirely. 

Claims 15-16 and 21-22 are rejected as being dependmt on an indefinite claim. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claim 1 is rejected under 35 U.S.C 103(a) as being unpataitable over Fang et al. (USPN 5,771,3 18) in 
viewof Asimopoulos et al. (USPN 6,195,467). 

With regard to claim 1, Fang discloses a similarity judging step in \\iiich similarity among pixels are 
judged along fom directions in a local area containing a target pixel undergoing low-pass filtering (column 3 line 63 
- column 4 line 25). The calculation of the local directional variances as disclosed in Fang is analogous to the 
similarity judgment recited in the claims in that it judges similarity among pixels along at least four directions in a 
local area containing a target pixel y(i j) undergoing low-pass filtering. 
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Fang furtha discloses a direction-depmdent low-pass filtering step of performing a weighted averaging 
operation in v^ich weighted pixel values of pixels around a target pixel are added to a pixel value of said target 
pixel and a result of said addition is divided by the sum of the weights (column 4 lines 35-50). Fang furtha* 
discloses a weighting rate, along a direction manifesting marked similarity, becoming increased based upon the 
similarity judgment (column 4 lines 43-55). 

Fang further discloses that similarity is judged by using characteristic differences (i.e. directional variances) 
among a plurality of pixels located on lines passing through the target pixel along specific directions (column 4 lines 
33-37 in conjunction with Figure 1), but fails to expressly disclose that similarity is also judged using characteristic 
differences of pixels located on lines passing near the target pixel along specific directions. 

Asimopoulos, however, discloses using charactmstic differences among a plurality of pixels located on 
lines passing through said target pixel along specific directions and characteristic differences among a plurality of 
pixels located on lines passing near the target pixel along specific directions (Asimopoulos Figure 6 in conjunction 
with col. 13 line 50 - col. 14 line 63). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to modify Fang's low-pass filtering method by having the similarity judging step utilize characteristic 
differences between pixels passing through the target pixel and near the target pixel as taught by Asimopoulos. 
Such a modification would have allowed for a more robust detection of image edges (Asimopoulos col. 14 lines 2-5) 
which would have allowed for a more accurate enhancement of the target pixel (Asimopoulos col. 13 lines 65-66). 

7. Claims 13, 15-16, 19 and 21 are rejected undo* 35 U.S.C 103(a) as being unpatentable over Fang in view 
of Okisu (USPN 6,091,862). 

With regard to claim 13, Fang discloses a method for low-pass filtering image data which comprises a 
similarity judging step and a direction-dependent low-pass filtering step (see the above argument with respect to 
claim 1). Fang fails to expressly disclose that the image data has values regarding a first color and values regarding 
a second color or a color difference between said second color and said first color. It follows that Fang also fails to 
expressly disclose that weighting rates are obtained based upon said first color and/or luminance values in A\iiich a 
weighting to said first color is high and weighted averaging is performed for said second color or said color 
difference using said weighting rates in said direction-depmdeat low-pass filtering step. 

Okisu, however, discloses that the image data has values regarding a first color and a second color (Okisu 
col. 4 lines 1 8-22). Okisu further discloses obtaining weighting rates based upon a first color in which the weighting 
to the first color is high (Okisu col. 5 line 63 - col, 6 line 7). The weighting rates (i.e. the 'weight of the pixel 
values') disclosed in Okisu are based upon a first color (green). Okisu discloses that the weighting to the first color 
is hi^ (Okisu col. 1 lines 59-61). The higha- sampling firequency disclosed in Okisu is analogous to the claimed 
'high weighting to the first color'. Okisu further discloses that weighted averaging is performed for the second color 
using said weighting rates (Okisu col. 4 lines 25-31). It would have been obvious to one reasonably skilled in the art 
at the time of the invention to modify Fang's image processing method by adding the capability to process color 
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image data as tau^t by Okisu. Such a modification would have allowed for a more robust system that could 
process color images as well as gray-scale images. 

With regard to claim 19, a computa-readable recording medium that stores a program which causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in the combination 
of Fang and Okisu is to function. Therefore, a computer-readable recording medium is inha*ent in these teachings. 

With regard to claim 15, Okisu furtho- discloses that the image data are gGio-ated by performing color 
separation in which reflected light from an object is captured with color filtas arranged in a Bayer array (Okisu col. 
1 lines 17-23). The limitations recited in the second paragraph of claim 15 have already been addressed with regard 
to claim 13. 

With regard to claim 16, Okisu discloses implemmting processing on G color image data, R color image 
data and B color image data (Okisu col. 4 lines 26-3 1). Okisu also discloses implementing processing on color 
difference data (Okisu col. 4 lines 37-63). 

With regard to claim 21, Fang discloses a direction-dependent low-pass filtering step with four weighting 
rates corresponding to four different filto- directions. It can be seai in Figure 1 that one of weighting rates is applied 
for the pixels to the left and right of the target pixel, one of the weighting rates is applied for the pixels above and 
below the target pixel, one of the weighting rates is applied for the pixel above the target pixel on the right and 
below the target pixel on the left, and one of the weighting rates is applied for the pixel above the target pixel on the 
left and below the target pixel on the ri^t Although Fang does not explicitly state that the target pixel itself has a 
weighting rate associated with, we can see from Figure 1 that the target pixel is used in the detamination of all of 
the four other weighting rates. As a result, a first weighting rate for the target pixel is inherent in Fang's direction- 
dependent low-pass filtering step. 

8. Claims 4-7 are rejected under 35 U.S.C. 103(a) as being unpatmtable over the combination of Fang and 
Asimopoulos as applied to claim 1 above, and fixrthCT in view of Shiraishi (USPN 5,253,046). The arguments as to 
the relevance of Fang and Asimopoulos as applied above are incorporated ho-ein. 

With regard to claim 4, the combination of Fang and Asimopouslos discloses a similarity judging step, but 
fails to expressly dislclose that the image data being judged is a color image with at least two types of color 
information. Shiraishi, however, discloses performing processing on at least two types of color information 
(Shiraishi column 10 lines 59-61 in conjunction with element 112 of Figure 6). It would have been obvious to one 
reasonably skilled in the art at the time of the mvention to modify Fang and Asimopoulos's similarity judging step 
by adding color image processing capability as taught by Shiraishi. Such a modification would have made for a 
more robust system that could do similarity judging and subsequent low-pass filtering on additional types of images. 

With regard to claim 5, Shiraishi further discloses that processing is performed on a color image that has 
yet to undergo interpolation processing (Shiraishi column 23 lines 45-49 in conjunction with Figure 28). 
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With regard to claim 6, the combination of Fang and Shiraishi discloses calculating similarity values along 
specific directions using characteristics differences of color image data. Calculating characteristics differences 
among a plurality of same color pixels and/or a plurality of different color pixels is inho-Qit in the calculation of the 
characteristics differences of a color image along specific directions. Tho-efore, this is inho-ently taught in the 
combination of Fang, Asimopoulos and Shiraishi. 

With regard to claim 7, Shiraishi furtha- discloses that the image processing is paformed on color image 
data having undergone white balance processing (Shiraishi column 10 lines 55-61 in conjunction with element 1 1 1 
of Figure 28). 

9. Claim 8 is rejected under 35 U.S.C. 103(a) as being impataitable over the combination of Fang, 
Asimopoulos and Shiraishi as applied to claim 6 above, and further in view of Ikeda. The arguments as to the 
relevance of the combination of Fang and Shiraishi as applied in paragraph 6 above are incorporated herein. 

The aforesaid combination discloses all of the limitations of claim 8 except that it fails to expressly disclose 
the step of detecting a degree of saturation of a target pixel in the calculation of characteristics differences of a 
plurality of color pixels. Ikeda, however, discloses determining a saturated region of a color image in a low-pass 
filter enviroimieat (Ikeda column 3 lines 20-25). It would have been obvious to one reasonably skilled in the art at 
the time of the invention to modify the image processing method for low-pass filtering a color image as disclosed in 
the combination of Fang and Shiraishi by detecting a degree of saturation of the color pixels as tau^t by Ikeda. 
Such a modification would have allowed for a system in which characteristics differences of color pixels were 
detected with regard to saturation components of the color pixels in addition to the color components. 

10. Claims 9-1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Fang and 
Asimopoulos as applied in claim 1 above, and further in view of Ikeda. The arguments as to the relevance of the 
aforesaid combination as applied above are incorporated haein. 

With regard to claim 9, the combination of Fang and Asimopoulos discloses a direction depoident low-pass 
filtering processing which is implemented on target pixels of an image data, but fails to expressly disclose that said 
image data undergoes interpolation processing to interpolate pixels with missing color components. Ikeda, however, 
discloses a low-pass filter oivironment in which color intapolation processing is pa-formed (Ikeda colunm 6 lines 
15-22 in conjunction with Figure 5). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to combine the color image data interpolation processing as taught by Ikeda with Fang and 
Asimopoulos' s method of performing directional dependmt low-pass filtering on an image. Such a modification 
would have allowed for a more robust system that could perform the low-pass filtering operation on color image 
data that had previously been interpolated. 
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With regard to claim 10, Ikeda furtho* discloses limiting pixel values of color pixels by a threshold 
corresponding to a largest pixel value or a smallest pixie value in a specific area near the corresponding pixel (Ikeda 
column 9 line 59 - column 10 line 14). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to combine the limiting of pixel values by using maximum and minimum threshold values as tau^t by 
Ikeda with Fang and Asimopoulos's method of performing low-pass filtering on an image. Such a modification 
would have allowed for intapolation results which did not fall outside the upper and lower boundaries of the pixels 
in an area. 

With regard to claim 1 1, Ikeda discloses performing interpolation processing on color image data that has 
yet to undergo low-pass filtering processing (Ikeda column 6 lines 15-19 in conjunction with Figure 5). It is well 
known in the art that a color image data in which one color (a first color) has a higher pixel density than another 
color (a second color) will inherently contain vacancies of color information. The steps of calculating a color 
difference between the first and second color, obtaining an interpolation value based on the difference, and then 
restoring the second color based on the intopolation are all inha-eat in the process of performing interpolation 
processing on color image data. Consequentiy, the limitations of the claim are inherent in the combination of Fang, 
Asimopoulos and Ikeda. 

1 1. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatmtable over the combination of Fang, 
Asimopoulos and Ikeda as applied to claim 1 1 above, and fiirther in view of Shiraishi. The arguments as to the 
relevance of the aforesaid combination as applied above are incorporated herein. 

With regard to claim 12, Shiraishi further discloses that processing is pa-formed on a color image that has 
yet to undergo intaT)olation processing (Shiraishi column 23 lines 45-49 in conjunction with Figure 28). It would 
have been obvious to one reasonably skilled in the art at the time of the inveation to modify the direction dependmt 
method of low-pass filtering a color image disclosed in the combination of Fang, Asimopoulos and Ikeda by 
including the further limitation of interpolating a color image that has aheady undergone image processing as taught 
by Shiraishi. Such a modification would have made for a more robust system that could interpolate the color image 
either before or afto- low-pass filtering of the image has been performed. 

12. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatmtable over Fang and Okisu as applied to claim 
2 1 above and furtho" in view of well known prior art. Fang discloses the first weighting rate for the target pixel is 
(l/2m + 1) (Fang column 4 equations 10. 1 - 10.4). The summation toms of those four equations, which are 
multiplied by (l/2m + 1) as disclosed in Fang are analogous to tt, yy, nu, and ns as recited in the claim. The claimed 
value, k, which represmts a predetermined value, is simply 1 in the equations of Fang. Althou^ Fang does not 
expressly disclose that the terms analogous to claimed tams tt, yy, nu and ns add together to equal 1, this furtha* 
limitation maely calls for the normafization of the four terms. Normalization is well known in the art (Official 



Application/Control Number: 09/592,285 
Art Unit: 2621 



Page 9 



Notice), and it would have been obvious to a person of ordinary skill in the art at the time of the invention to include 
the normalization of the four tams. Such a modification would have resulted in more efScient computations. 



14. Applicant's amendmmt necessitated the new ground(s) of rejection presented in this Office action. 
Accordingly, THIS ACTION IS MADE FINAL, See MPEP § 706.07(a). Applicant is reminded of the extmsion 
of time policy as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final 
action and the advisory action is not mailed until after the md of the THREE-MONTH shortened statutory period, 
then the shortoied statutory period will expire on the date the advisory action is mailed, and any extension fee 
pursuant to 37 CFR 1. 136(a) will be calculated from the mailiag date of the advisory action, hi no event, however, 
will the statutory period for reply expire lata* than SIX MONTHS from the date of this final action. 

15. Any inquiry concerning this commuiucation or earlier communications from the examino: should be 
directed to Patrick L Edwards whose telephone number is (703) 305-6301. The examiner can normally be reached 
on 8:30am - 5:00pm M-F. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's supervisor, Leo Boudreau 
can be reached on (703) 305-4706. The fax phone number for the organization wha-e this application or proceeding 
is assigned is 703-872-9306. 

Information regarding the status of an appHcation may be obtained from the Patent Application Information 
Retrieval (PAIR) system. Status iaformation for published applications may be obtained from eitho- Private PAIR 
or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more 
information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the 
Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Allowable Subject Matter 



13. 



Claims 2 and 3 are allowed 



Conclusion 



pie 



Patrick Lynn Edwards 





